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1 INTRODUCTION 



Hidden measurements were introduced by Aerts [2] to show that it is possible 
to understand quantum probabihties as arising from a lack of knowledge about 
the interactions between a measuring device and the system that it is measuring. 
In this way, quantum mechanics can be understood within classical probability 
theory with the peculiarities of quantum probabilities arising from a simple lack of 
knowledge and not some mysterious source. The hidden measurement formalism 
is just one of a number of approaches that try to find a classical representation for 
probability structures in quantum mechanics. For example, stochastic extensions 
of the Schrodinger equation have been proposed to account for the collapse of the 
wave function [1,16] and hence the appearance of quantum probabilities. It has 
also been observed that quantum like behavior can arise within classical systems 
[2,4, 14, 17, 18,20]. The fact that it is possible to find classical representations for 
the probability structures in quantum mechanics and that quantum like behavior 
arises in non-quantum systems hints that eventually quantum mechanics will be 
understood within classical probability theory. 

To describe hidden measurements, we denote by X the set of possible states 
of a system S and by Y the set of possible states of the measuring device M. 
used to measure S. Given that the system is in a state x & X and the measuring 
device is in the state y e y, we let z — A4{x,y) denote the outcome of the 
measurement. The measurement is assumed to be deterministic so if we let Z 
denote the collection of all possible measurement outcomes then {x, y) h- > y) 
defines a map from X xY to Z. The fact that the result of a measurement 
depends on the state of the measuring device is the justification for the name 
"hidden measurements" . 

To formalize the above discussion, we need two measure spaces (X x "K, A{X x 
Y)) and {Z,A{Z)). Here we are using A{X x Y) and A{Z) to denote cr-algebras 
on X X Y and Z, respectively. A deterministic measurement is defined to be a 
measurable map (i.e. a random variable) 

M:XxY — >Z. (1.1) 

The state of the system plus measuring device is assumed to be uncertain and 
characterized by a probability measure jj, on {X x Y, A{X xY)). The probabihty 
of a measurement yielding an event U e A{Z) is then given by 

PToh{M eU\n):= I II. (1.2) 
Jm-^{u) 

Prom this it can be seen that the probability of a measurement obtaining a 
certain value is due not only to the uncertainty of the system but also to the 
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uncertainty in the state of the measuring device which is characterized by the 
measure /x. Even in the situation where there is no uncertainty in the state of 
the system there can still be uncertainty in the state of the measuring device and 
hence the outcome of a measurement is probabilistic. In the terminology of [5], 
a deterministic measurement is referred to as rule of interaction. In that paper, 
the special case where the measure /i in (jl.2j) factors as a product of measure on 
X and Y (i.e. = /i^/iy) is called an interactive probability model. For more 
discussion on the philosophical foundations of the hidden measurement formalism 
we refer the readers to the papers [2,3] and references cited therein. 

The hidden measurement formalism has continued to be developed by a 
number of authors and various hidden measurement schemes have been con- 
structed [4-8,11,12]. The range of possible hidden measurement schemes have 
been classified in [9,10] and for finite dimensional quantum systems no preferred 
scheme is identified. Criteria for selecting out a preferred scheme is still lacking 
and thus different hidden measurement schemes should be investigated so their 
relative merits can be compared. 

The aim of this article is to introduce a new hidden measurement scheme 
for finite dimensional quantum systems based on the concept of representing 
quantum transition probabilities by the volume of regions of projective Hilbert 
space. Since the measure we use in constructing the hidden measurement scheme 
factors, our construction defines an interactive probability model. For dimension 
n = 2 our scheme is isomorphic to the sphere model of Aerts [2, 14]. This can 
be seen through the isomorphism P7i = S"^. For dimensions n > 3 our approach 
offers a significant improvement over previous schemes in that it is geometrical in 
origin and is formulated on projective Hilbert space (i.e. we take X = Y = FTi for 
some Hilbert space P7i ) which is the natural state space of quantum mechanics. 
This allows for a clear understanding of how the group of unitary transformations 
acts on our hidden measurement scheme. 

With the exception of the 2 and 3 dimensional models presented in [2] and [4] , 
previous hidden measurement models have essentially used, in the notation above, 
X = TioT S{T-C) and for Y a simplex sitting in M". The choice of the simplex for Y 
arose from the observation that given a quantum state ip and an orthonormal basis 
{ipi, . . . , ipn}, the transition probabilities Pii),.{;ip) ■= \ {'ip\4'k)\'^ regarded as a vector 
(p^-^(V'), . . . ,PVn(V')) inust lie in the simplex {(xi, . . . , x„) | Xj > and Y^i^i = 
1}. The hidden measurement scheme is then implemented by partitioning the 
simplex into n regions with volume equal to the transition probabilities p^f,{il)). 
The limitations of the scheme is that for each commuting set of observables a 
new simplex must be introduced and a priori it is unclear how the different 
measurement systems are related. We note that in [13] it is shown that by fixing 
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one hidden measurement scheme for one set of commuting observables that it 
is possible to use a group translation procedure to induce hidden measurement 
schemes for the other commuting sets of observables in a manner that is consistent 
with quantum mechanics. However, due to the abstract method of enforcing the 
action of the unitary group it is difficult to get a global picture of the measurement 
scheme and the relations between different observables. In contrast our method 
supplies a hidden measurement scheme for each set of commuting observables and 
at the same time provides a natural action of the unitary group on the schemes 
and shows that the entire collection is compatible with quantum mechanics. The 
action of the unitary group is natural and easy to understand. 

We also show how to construct a hidden variables scheme based on hidden 
measurements. Here we are taking the term hidden variables to mean representing 
quantum observables and quantum states as random variables and probability 
distributions, respectively, on a fixed space. Due to the nature of the measurement 
depending on the state of the measuring device, the type of hidden variables that 
we construct are contextual. A general discussion of this point can be found 
in [13] where it is shown that for any hidden measurement system it is possible to 
introduce a (non-unique) contextual hidden variables theory. Finally, we discuss 
how joint distributions for commuting observables arise in our hidden variables 
scheme and their relationship with the results of Fine [15]. 

2 PROJECTIVE HILBERT SPACE 

In this section we review some basic results about projective Hilbert space. We 
use the book [19] as our standard reference. Let {H, (■!■)) be a complex Hilbert 
space where the inner product (•!•) is taken to be linear in the second variable. 
Define 

7i^:=7i\{0} and C^:=C\{0}. (2.1) 

On Tl^ we can define an equivalence relation ~ by ^ ~ if and only if there 
exists a A e such that ■0 = Letting [i/j] denote the equivalence class for 
■0 e H^i we have 

[V'] :={AV^|AeC^}. (2.2) 
Projective Hilbert space FH is then defined as 

FH — W/ en''} . (2.3) 

It is well known that P7Y carries a Hilbert manifold structure for which the canon- 
ical projection tt : F7i ; ip >—>■ is a C°° submersion. As a consequence 
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for any q G YH and Vq G T^PTi there exists a ip e and (j) E H such that 
q = [ip] and Vg = T^tt ■ 0. Here we are using Tq¥T-C to denote the tangent space 
of P7i at g G P7i and T^vr : T^TY^ = Ti ^ T[^]P7i to denote the tangent map 
of the mapping tt : Ti^ — > P7Y. The above representations for points and tan- 
gent vectors on WH can be used to define a complex structure J and a strongly 
non-degenerate symplectic form uj on WH via the formulas 

JI(T^7r ■ 0) := T^TT • # (2.4) 

and 

a;[^](T^7r • 0i,T^7r • := 2n||V||-^Im ((0i|(/.2) HVll' - (0i|V)(V'|02)) (2.5) 

for every ip G and 0, 0i,02 G Recall that a symplectic form is a non- 
degenerate closed two form. It should be noted that g{v, w) = uj{v, Iw) defines a 
Riemannian metric on WH and hence establishes that WH is a Kahler manifold. 

Given a function / G C°°(WH), the non-degeneracy of the symplectic form u 
implies that the following equation 

u;{Xf, Y) = d/(y) for all vector fields Y on FH, (2.6) 

uniquely defines a vector field Xf. The Poisson bracket {■, ■} is then defined via 

{f,g}:^u;{Xf,Xf) V /, ^ G C~(P7i) . (2.7) 

Let C{H) denote the set of bounded hnear operators on H. Then the unitary 
group U(7i) is defined by 

v{n) := {u G c{n) I {Utij\U(t)) = (v.#) v^-, g 7i } . (2.8) 

Its Lie algebra u{H) is the set of skew-adjoint operators, i.e. 

u{n):^{AeC{n)\A^ ^-A}. (2.9) 

Here we are using f to denote the adjoint of an operator. The following map 

p : \]{n) xWH^WH : (U, [ijj]) [U^j] (2.10) 

defines an action of V{H) on ¥H by symplectomorphism (i.e. p^u; — oj for all 
U G U('H)). There also exists an equivariant momentum mapping J : WH — 
u(7i)* for this action defined by 

i^:s{Xi,\),A):=iM^ ^,pen,Aeu{n), (2.11) 
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where (■, ■) denotes the canonical pairing between u(?i)* and uiH). Letting 
C°°(P?i) denote the set of smooth functions on VH, the momentum map can 
be viewed as a map J : u(H) — > C°°(FT-C) by defining 

3{A){x) := {J{x),A) yxeFH. (2.12) 

Recall that the defining property of a momentum map is that 

u}{A,Y) = dJ{A){Y) (2.13) 

holds for all vector fields Y on F7i and A G u(7i) where A is the vector field on 
VH generated by A, i.e. 

while an equivariant momentum map satisfies the additional condition 

{Jo pu{x),A) = {J{x),U-'^AU) yxe¥n,Aeu{H),Ue\]{H). (2.15) 

It follows from the equivariance that 

{3{A),3{B)} = J{[A,B]) VA,Beu{n). (2.16) 

Let Sa(H) denote the set of bounded self-adjoint operators on H. For each 
operator H G Sa(7-^) 

{H) := 3i-lH) (2.17) 

defines a smooth function on FTi. This function is just the usual expectation of 
the observable H, i.e. 

(2.18) 



With this notation ()2.16p can be written in the more familiar form 

{{A),{B)} = {l[B,A]). (2.19) 

3 ACTION ANGLE COORDINATES ON FH 

For the remainder of this article, we will assume that dim 7^ = N < oo. Let 
{ipi, . . . , iPn} be an orthonormal basis for 7i. Define the projection operators 

p^, = m{^pk\. (3.1) 
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We can use the momentum map to define smooth functions p^^, on P7i by 

■■= (P^,) ■ (3.2) 

Using we get that 

P*m) = (3.3) 

which is the transition probability from the state ip to ipk- As the operators P^^ 
commute, formula ()2.19|) shows that the functions {p^n • • • ^PiPn} involu- 
tion, i.e. 

{^„V'fc} = \/j,k = l,2,...N. (3.4) 
It follows from I = ^^Li ^^^^ 

N 

^PVfe = l' (3-5) 
i=i 

which shows that at most (A^ — 1) of the functions p^^, can be independent. It 
is not hard to show that the set {p^^y ■ ■ ■ ^PtZ-jv) is independent. That is the set 
of points in VH for which the covectors {dp^^, . . . , dp^^} are linearly dependent 
has measure zero. Consequently, we can use these functions to construct action 
angle coordinates of P7i following the standard recipe, see [19] for details. This 
results in the following coordinate chart 

r : T^-^ X S — >¥n 

N N 

{6, 1) = ((^2, ...,e^),{h,...,Ir,))^ [(1 - h) '^Vi + ^'^'^ V^^i 

k=2 3=2 



(3.6) 



where ^ is the (A^ — 1) torus and 

N 



^:={(/2,...,/iv)GM^-M0</,- ^J,<l}. (3.7) 



i=2 

In this chart, the symplectic form uj is given by 

N 



io = hYdOk Adik. (3.8) 

i=2 
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We also note that the functions p^^. have the coordinate representations . {9, 1) = 
Ij for j = 2, 3, . . . , A^. Using u, we can define a volume form u on F7i by 

z/:=f^j ^u; A ■ ■ ■ A cc; ■ (3.9) 

^ ^ N-l times 

Locally this is given by 

V = ^2jcyN-i) d92A...A9NAdl2A...AdlN- (3.10) 

Then because the chart ()3.(ij) covers all of P7i except for a set of measure zero, 
the volume of FTi is given by 

Vol(P7i) = / . . . / de2...d9N dl2...dlN. (3.11) 



(2vr)(^-i) 

A straightforward calculation shows that Jgdl2 ■ ■ ■ dl^ = 1/(A^ — 1)! and hence 
Vol(PH) = 1. 



4 VOLUME REPRESENTATION OF TRAN- 
SITION PROBABILITIES 

Suppose ip^cj) & Ti^ . Then the transition probability from the state ip to or 
vice versa, is given by 

T(V^,0) := , ; . (4.1) 



As this formula is invariant under scaling of or by non-zero complex numbers, 
it passes to a well defined function on P?i x P7^ given by 



It was shown in [21] that if we let d{x,y) denote the geodesic distance between 
points x,y E P7i then the distance d{x, y) is related to the transition probability 
T{x,y) via the formula 



T(x,y) = cos^(^). (4.3) 
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Figure 1: Volume representation of transition probabilities 

This shows that there exists a representation of the transition probability in terms 
of the geodesic distance. The question now is, are there other representations for 
the transition probability in terms of geometrical objects on P7i? We will show 
that the transition probability, at least for finite dimensional Hilbert spaces, can 
be related to the volume of certain regions in P7i. To motivate this, we will first 
look at P7Y where 7i is a 2 dimensional Hilbert space. Recall that FTi = S"^ where 
S"^ is the ordinary two sphere in M^. Suppose {ipi,ip2} is an orthonormal basis 
for Ti and ip G Ti.^ is an arbitrary state vector. Since {ipi,il!2} is orthonormal, 
we can choose them to be the north and south poles of S'^ as in Figure ^ The 
symplectic form on S"^ is 

u; = ^^d(f)Ade (4.4) 
while the volume form u is given by 

^ w . (4.5) 



2h7i 



The normalization on the volume form is chosen so that Jp^ u = 1. 

Referring to Figure ^ let fl be the shaded region between the points [ipi] and 
[ip]. Then a straightforward calculation shows that 

T([^2],M)=Vol(fi):= / u. (4.6) 

Jn 
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Of course if we let 7 be the geodesic between [ip] and [Tp2\ represented by the 
dashed hne in Figure Q then we also have 



= cos 



^{{2h) ^(geodesic lenth of 7)) . 



(4.7) 



Letting Q'^ denote the complement of we also have 




(4.8) 



It is interesting to note that the conservation of probability 1 = T(['?/;i], [ip]) + 
T{[ip2], [ip]) has the simple geometric representation P7Y = i7 U Q'^. 

To generalize the above construction to arbitrary but finite dimensions we 
must first find a method for generalizing the decomposition P7i = U Q'^. So 
for the moment, let us still assume that dimTi = 2 and that {ilJi,ijj2} is an 
orthonormal basis. Letting Qi := Q and Q2 '■= a short calculation then shows 
that 

X eQk if and only if p^^ {x)p^^ (y) > p^^ {x)p^^ {y) for j = 1,2, (4.9) 

where y = [^]. This motivates us to make the following definition. Let Ti be an 
N dimensional Hilbert space. Suppose (3 = {ipi, . . . , iPn} is an orthonormal basis 
for TC. Then define a region fl{y,P,ipj) of VH that depends on a point y G VH, 
the basis (3, and a particular basis vector ipj by 



^{y,P,i^k) := {x eVH \py,^{x)p^^{y) >p^,{x)p^^{y) for j = 1, 2, . . . , iV } . 



It is useful to introduce an alternate characterization for Q{y, (3,ilJk) which 
seems more complicated but is actually easier to work with. To start, consider 
the following vectors in M^~^ 



ei:=0 and ^,+1 := (0, • • • , 1 , • • • , 0) j = 1, 2, . . . , iV - 1 . (4.11) 



(4.10) 



jth 



Let 



N 




(4.12) 



and define 



N 



N 



N-l 



Ik > and 




(4.13) 
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Proposition 4.1. Suppose (3 = {ipi, . . . jIPn} is an orthonormal basis for Ti and 
y e¥n. Then 

N 

n{y,f3,^k) = {xeFn\ Y,P^,{x)Cj e S{y,f3,^,) } . (4.14) 

i=i 

Proof. Assume that p^,.{y) 7^ 0. The case Pip^iy) = will be left to the reader. 
Then using (j4.12|) . we can write J2j=i Pi'ji^)^] 

j:p,a-)= e (4.15) 

From ()3.5p it is easy to see that 

These two results along with p^. > show that 

N-l 

^P^,{x)^j e S{y,(3,^k) Pi>,{x)p^^{y) > p^^{y)p^^{x) (4.17) 

for j = 1, 2, 3, . . . , A^. □ 

The next two propositions show that the sets Q{y,/3,tpj) have the required 
properties to be considered a generalization of the sets f2i = and Q2 = from 
the previous section. 

Proposition 4.2. Suppose P = {ipi, . . . , i/jn} is an orthonormal basis for 7i and 
y EFH. Then 

N 

Fn=[jQ{y,(3,iJk) (4.18) 

k=l 

and 

Vol(f^(y,AV,) n (](?/, /3, Vfe)) =0 forj^k. (4.19) 
Proof. Let S denote the closure of S defined by ()3.7|1 . i.e. 

N 

S = \^ (as, . . . , otv) G K^"^ I % > and ^ < 1 j (4.20) 

i=2 

11 



and define a map J : P7i M ^ by 

N 

J(x)=^p^^.(x)e,. (4.21) 
i=2 

Since p^^ > and J2f=iP^j = 1, we have that J(P7i) C S. To see that this 
inclusion is actually an equality, consider any state vector (p = J2j'=i '^j'^j where 
at least one of the coefficients Cj is non-zero. Then (p G and 

1 ^ 

J([0]):= ^ (4.22) 

It follows directly from this formula that J(P7Y) = S. Also, it is not hard to verify 
that 

N 

S=[jS{y,(3,^,). (4.23) 
i=i 

The above two results and proposition l4. ll then imply that FTi. = UjLi ^(2/? V'j)- 
From proposition 14.11 and the definition of J, we have that VL{y , (3 , j) = 
J {S{y, I3,ipj)). Consequently 

n{y, P, ij^) n Q{y, P, tPk) = T\s{y, P, ^,)) n T\s{y, P, tPk)) 

= T\siy,P,^,)nSiy,P,^k)). (4.24) 

But for j 7^ k, the set S{y,P,iljj) fl S{y,P,ipk) lies inside an — 2 dimensional 

subset of R^~^ and hence J {S{y, P, ipj) H S{y, P, ipk)) must have measure zero. 
Therefore for j ^ k the formula Vol(i7(?/, /5, V'j) H i7(?/, /5, T/'fc)) = follows. □ 

Proposition 4.3. Suppose {%pi, . . . , i^n} is an orthonormal basis for Ti and y G 
FH. Then 

Vol(^](l/, P, ^,)) = p^^ {y) J = 1, 2, . . . , iV . (4.25) 

Proof. It is enough to prove it for j = N. From proposition 14.11 and equations 
(jm - fpmH) it is clear that 

Vo\{n{y,P,ijN))= [ ■■■ [ d92...d9r, [ dh-.-dl^ 

{2n)(N - 1) Jo Jo Js{y,p,i,M) 

= {N-1)\ [ dh.-.dlN (4.26) 
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But from (j4.12p and (j4.13|) it is easy to verify that 

dh--- diM = TTT^P^iv (y) , (4-27) 
which completes the proof. □ 



5 HIDDEN MEASUREMENTS 

We are now ready to construct our hidden measurment scheme. To begin, let A 
be a self-adjoint operator with spectral resolution 

M 



A:=J^a/P/ (5.1) 



1=1 

where the projection operators Pj can be further decomposed into 

mj 

for some orthonormal basis { ipj^mi | 1 < < M, 1 < j < rrii}. Here {ai, . . . , om } 
are the distinct eigenvalues of A with multiphcities {mi, . . . ,mM}- Note that 
n = nil + ■ ■ ■ + fnM- 

Let Hi := PiiTi). Then each of the projection operators defines a map 

: \ Ti{{njY) FH ; ^ [Pi^] . (5.3) 

For notational convenience we extend the maps Pj to all of P7i by defining 

I X otherwise 

Note that this map is essentially the linear map i/j — *■ Pji/j projected down to P7i 
where we have taken care of the case when Pjip = 0. 
Let P = { 4'j,mi |l<-^<Af, I < j < mj} and define 

n{y,P,Pi) :=int (^n{y,P,i:,^m,?j ■ (5.5) 
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Then it follows from theorems 14.31 and 14.21 that 

mj 

and 

Vo\{n{y,P,Pi)nn{y,P,Pj))=0 I^J. (5.7) 

But (Pf) ([■?/']) = ^^i^ja^^ , and hence ()5.fj|l and ()5.7|) provide a volume representation 
of the transition probability. 

We define a deterministic measurement associated to A by 

I X otherwise 

To reproduce quantum mechanics, for each quantum state x G WTi we define a 
measure on FTi x FTi by 

11^ = 5x X u (5.9) 

where ^^.^ is the Dirac measure on FTi with support at x and u is the volume form 
(j3.9j) . This choice of measure can be interpreted as saying that we are certain 
that the system is in the state x but the measuring device is characterized by a 
uniform distribution over its state space. Initially, we have maximum information 
about the state of the system but minimum information about the state of the 
measuring device. 

From the definition of our deterministic measurement ()5.8|1 . it is easy to 
see from p.2|l that given the state fix there are exactly M possible outcomes 
{Pi{x), . . . , Pm{x)} with probabilities 

Fioh{MA = Piix)\fXx) = {Pi)ix) for /= 1,2,...,M. (5.10) 

This exactly reproduces the projection postulate and hence quantum probabili- 
ties. 



M 



d[[jn{y,(3,Pi)\ , (5.6) 



kI=1 



6 HIDDEN VARIABLES 

Hidden measurements are a special case of hidden variables. In this section we 
will write the hidden measurement scheme introduced in the previous section as 
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an explicit hidden variables scheme. To accomplish this, for each self-adjoint 
operator A we define a random variable 

fA-.mxFH — >m (6.1) 

by 

fA:={A)oMA. (6.2) 

Then from ()5.6|) and ()5.8|) it is clear that J'a can take on only M distinct values 
{ai, . . . , om} and that 

//M= U Mxfi(2/,/3,P/). (6.3) 

Therefore 

Prob(/^ = a, l/ij = / fi, = {Pj){x) for/ = l,2,...,M (6.4) 

by ()5.6|) and ()6.3|) This reproduces all single observable measurements in quantum 
mechanics. Note in particular that we have the identity 

{A){x) = J fAfi.. (6.5) 

To completely reproduce quantum mechanics we must also deal with the joint 
distributions of commuting observables. So suppose A and A' have the following 
spectral resolution 

M M' 

A = Y^ aiPi and ^' = XI ^'i^i ' (S-^) 

7=1 1=1 

Fixing a common basis of orthonormal eigenvectors (3 = {ipi, ■?/'„} for A and 
A', it is easy to see that 

n{y, P, Pj) n n{y, P, P'j) = niy, P, PjP'j) (6.7) 

From this result, the definitions of M.a and A^a', and ()6.3p we get 

//Mn/^/(a',)= U yxn{y,P,PiP'j). (6.8) 
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From this and (|5.6|) it follows that 



[ /i. = Vo\{n{y,P,PjP'j)) = {PiP'j){x) . (6.9) 

>^/l'K)n/-/(a'^) 



Therefore 



ViohUA = aijA' = aj\ii,)= [ /i, = (P,P;)(x) (6.10) 

for 1 < I < M and 1 < J < M'. The generalization to 3 or more commuting ob- 
servables is obvious. We see from (j6.4j) and (|6.1U|) that all of quantum mechanics 
can be reproduced by the random variables Ja and the measures Hx- 

It is also worthwhile to take some time and examine the relationship between 
Ia, Ia', and /aa' for commuting operators A and A'. We would expect that the 
random variables /aa' and /aIa' should be equivalent. To see this we first note 
that from (|6.6|) we have 

M M' 

AA = Y,Y.^i^'jP^P'j ■ (6.11) 

1=1 J=l 

For simplicity we assume that the values {a/a'j | 1 < / < M, 1 < J < M'} are 
distinct. The following results hold true even if the values aiaj are not distinct 
and will be left to the reader. From this and the definitions of A^a, M.a', -Maa', 
/a, /a', and /aa' it follows that 

Iaa' = IaIa' a.s. with respect to the measure Hx (6.12) 

and hence the random variables fAA' and /a/a' are indeed equivalent. 

We also note that density matrices can be easily incorporated into our for- 
malism. To see this, again suppose {V'l, . . . , ^n} is an orthonormal basis and that 

N 

j=i 

is a density matrix (i.e. > and Ylj=iPj ~ 1)- -Due to the uncertainty in the 
state of the system we replace the Dirac measure in (j5.9|) by Yyj=iPj^Xj where 



X 



3 



So if we let 



= i^Pj^-?) ^ ^ ^ (6-14) 
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it follows from and (IFTTD that 

n n 

Prob(/A = ai I fXp) = ^PjProb(/A = aj \ /i^J = '^Pj{Pj){xj) . (6.15) 

i=i j=i 

But 

n n 

J]p,(P,)(x,) = J2pM\Pi^j) = Tr(pP/) , (6.16) 

and hence it follows that 

Prob(/A = a/ I /ip) = Tr(pP/) for / = 1, 2, . . . M (6.17) 

which reproduces the density matrix formalism in quantum mechanics. One point 
worth mentioning is that if the density matrix p had another expansion 

N 

i=i 

in terms of a different orthonormal basis {0i, . . . , 0n} then according to above 
prescription we would associate to p the measure 



n 

(E^A)x^ (6-19) 



where qj = [(pj]. Obviously p'p = pp if and only if {0i, . . . , 0^} and {ipi, . . . , ipn} 
are identical bases. However, p'^ and pp carry identical statistical information as 
far as quantum mechanics is concerned because 

Prob(/A = ai I Pp) = Prob(/A = ai \ p'p) = Tr(pP,) for / = 1, 2, . . . M (6.20) 

for every self-adjoint operator A by equation ()6.17|) . Thus p'p and Pp are equivalent 
measures from the quantum point of view. 



7 JOINT DISTRIBUTIONS 

Let us now consider ^ self-ajoint operators Ai, A2, . . . , Ai, which may or may not 
commute. From the previous section we can associate to each observable to a 
random variable Ja^ k = 1,2, . . . i such that 

FToh{fA,=a'}\p^) = {P!^){x) l<I<Mk (7.1) 
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where 

A, = J2^iPi (7.2) 
1=1 

is the spectral resolution of Ak. We are free to define a joint distribution for the 
random variables /^i, /as, • • • , fAe by 



Prob(/A: 




for 1 < 4 < Mfc, k = l,2,...,i. It would then appear from dHH) and (IFT^ 
the joint distribution ()7.3|) would have marginals that agree with all the possible 
quantum distributions. However, this contradicts the results of Fine [15] where 
he showed that if there exists a joint probability distribution with marginals that 
agree with the quantum probability distributions, wherever those are defined, 
then the correlations must satisfy Bell's inequalities. We know that for certain 
choices of observables and states that Bell's inequalities are violated. But our joint 
distribution ()7.3p was derived for an arbitrary set of observables Ai, A2, . . . , Ai 
and so we seem to have a contradiction. 

The resolution of the contradiction is that the random variables do not 
only depend on the observable A but also on the basis of orthonormal eigenvectors 
f3. The dependence on the basis vectors (3 is clear from the definition ()5.8p of 
the measurement maps Ma and the definition of the random variables ()6.2j) . 
Therefore to be more precise we will use the notation f{A,i3) to make clear this 
dependence. In the case where A has distinct eigenvalues there is only one basis 
/3 and hence a unique observable is associated to A. In all other cases where there 
are degenerate eigenvalues, there will be a family of random variables associated 
to A. This is particularly important in deriving the joint probability formula 
(16.1 up for commuting observables. During the derivation, we used the random 
variables /(a,/3) and /(a',/3)- The important point to understand is that we had 
to use a common eigenbasis (3 for both A and A' to get the correct answer. On 
the other hand, the single observable distributions ()6.4p are independent of the 
particular eigenbasis chosen. 

To understand how the choice of basis affect the joint distribution suppose 
that we have four self-adjoint operators Ai,A2,Bi,B2 such that Ai commute with 
the Bj. In other words, each of the four pairs of operators {Ai,Bi}, {Ai,B2}, 
{A2,Bi} and {^42,-82} are separately diagonalizable. To associate random vari- 
ables to these observables we need to fix bases of eigenvectors. So we will let 
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{Ai,ai), {A2,a2), {Bi,Pi), (32,^2) denote the operator-eigenbasis pairs. Let 

Mi Nj 

A = J2o^iPf' ^ = 1,2 and Bj = J2^jPp j = 1,2 (7.4) 
1=1 j=i 

be the spectral resolutions for the operators Ai and Bj. We can define a joint 
distribution for the random variables f(Ai,ai), f(Bj,aj) by 

Prob(/(A„a,) = al, f^B„t3,) = h\ | /i^) = / /i^ (7.5) 

for 1 < Ji < M,, 1 < Jj- < Nj, and i,j = 1,2 where 

V{al. h\) = f[la,)K) n /ri,„,)(4) n f[n\A^{bi) n f[l,^^{bl) . (7.6) 

For the moment, consider the single marginal arising from the joint distribution 

M2 Ni N2 

Prob(/Ai,ai = a]^ \f^x) = ^^Y1 P™b(/(A„a,) = a^, f^B,,(3,) = b^j^ I /ix) 

72 = 1 Jl=l J2=2 

^/x... (7.7) 
From ()5.6p and ()6.3|) it is clear that 

^ /i. = (P/^)(x) (7.8) 

is independent of the eigenbasis ai. Therefore the joint distribution ()7.5p will 
yield the correct single variable quantum distributions independent of a particu- 
lar choice of the eigenbasis and f3j. However, when trying to satisfy the two 
variable quantum distributions which arise from the fact that the pairs of op- 
erators Ai, Bj are separately diagonalizable is where confiict appears. So now 
consider the two variable marginal 

M2 N2 

Prob(/(Ai,ai) = /(Bi,/3i) = b\ I /ix) = 5Z 5^ Prob(/(A„a,) = a\,fi^B,,(3,) = I ^x) 

72 = 1 J2=2 

fix (7.9) 
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In order to apply equation (j6.9|) to ensure that the two variable marginal agrees 
with the quantum one, we must first assume that ai = Therefore it follows 
that 

Prob(/(A„„,) = f^B.^p,) = b\ I /i.) = {Pf^'Pf^Kx) (7.10) 

provided ai = Pi. From this we can conclude that the joint distribution ()7.5|) will 
yield the correct quantum variable distributions corresponding the the set of sep- 
arately commuting observables {Ai,Bi}, {Ai,B2}, {A2,Bi}, {A2, B2} provided 
ai = Pi, ai = P2, 0.2 = Pi, and 02 = P2- In other words ai = a2 = Pi = P2 and 
hence all the operators Ai,A2, Bi, and B2 must be simultaneously diagonalizable. 
Thus there is no contradiction with Fine's results [15]. 
We can make the following conclusions: 

(i) to each self-adjoint operator A = YliLi o-iPi and each orthonormal eigen- 
basis P oi A we can assign a random variable /(a,/3) defined by fl6.2|) such 
that 

Prob(/(A,^) = a/ l/i,) = / ^i, = {Pi){x) 1<I<M (7.11) 

for each x G VH, and 

(ii) if A = diPi, cind A' = Xl/li '^/-P/ ^.re simultaneously diagonahzable 
and /3 is a common eigenbasis then 

Prob(/(A,/3) = ai, f(A',/3) = a'j l/^x) = / /^x = {PiPj){x) 

(7.12) 

for 1 < / < M, 1 < J < M' and each x e VH. 

Note that equation (j7.11|) is independent of the basis P and that (j7.12p can be 
easily generalized to 3 or more commuting observables. 

8 CONCLUSION 

We have, for any finite dimension N, constructed a hidden measurement model 
for quantum mechanics based on representing quantum transition probabilities 
by the volume of regions in projective Hilbert space. The geometrical nature 
of our construction allows for a clear understanding of the action of the unitary 
group on the hidden measurement scheme in contrast to previous constructions. 



20 



We also showed how to construct a contextual hidden variables theory based on 
our hidden measurement scheme. 

While the hidden measurement formalism is an interesting way of looking 
at the theory of quantum measurements, the obvious weakness is that there is 
no physical principle behind constructing the deterministic measurements (see 
equations and (j5.8|) ) which are supposed to represent the interaction of the 
quantum system with real measuring devices. Since the results of this paper and 
previous work show that it is possible to have a consistent hidden measurement 
scheme for quantum mechanics, the question now is - can a realistic dynamical 
theory for the measuring device plus the system being measured be constructed 
which singles out a particular form of the deterministic measurement? If this can 
be done in a compelling manner then it would represent a significant advance in 
our understanding of the quantum theory of measurement. Some work in this 
direction is contained in [16] where the authors consider a model with determin- 
istic dissipative dynamics for the quantum measurement process. In dimension 
two, the geometry of the model is exactly the same as the Aerts' sphere model. 



ACKNOWLEDGEMENTS 

This work was partially supported by the ARC grant A00105048 at the University 
of Canberra and by the NSERC grants A8059 and 203614 at the University of 
Alberta. I would also like to thank the referee for his useful comments and 
criticisms. 



References 

[1] S.L. Adler, D.C. Brody, T.A. Brun, and L.P. Hughston, "Martingale models 
for quantum state reduction" J. Phys. A 34, 8795 (2001). 

[2] D. Aerts, "A possible explanation for the probabilities of quantum mechan- 
ics" J. Math. Phys. 27, 202 (1986). 

[3] D. Aerts, "The hidden measurement formalism: what can be explained and 
where quantum paradoxes remain" Int. J. Theor. Phys. 37, 291 (1998). 

[4] D. Aerts, B. Coecke, B. D'Hooghe, and F. Valckenborgh, "A mechanistic 
macroscopic physical entity with a three-dimensional Hilbert space descrip- 
tion" Helv. Phys. Acta 70, 793 (1997). 



21 



[5] S. Aerts, "The Born rule from a consistency requirements on hidden mea- 
surements in complex Hilbert space" preprint: quant-ph/0212151. 

[6] B. Coecke, "Generahzation of the proof on the existence of hidden measure- 
ments to experiments with an infinite set of outcomes" Found. Phys. Lett. 
8, 437 (1995). 

[7] B. Coecke, "Hidden measurement model for pure and mixed states of quan- 
tum physics in Euclidean space" Int. J. Theor. Phys. 34, 1313 (1995). 

[8] B. Coecke, "A hidden measurement representation for quantum entities de- 
scribed by finite-dimensional complex Hilbert spaces" Found. Phys. 25, 1185 
(1995). 

[9] B. Coecke, "Classical representations for quantum-hke systems through an 
axiomatics for context dependence" Helv. Phys. Acta 70, 442 (1997). 

[10] B. Coecke, "A classification of classical representations for quantum-hke sys- 
tems" Helv. Phys. Acta 70, 462 (1997). 

[11] B. Coecke, "A representation for a spin-s entity as a compound system in 
consisting of 2s individual spin-1/2 entities" Found. Phys. 28, 1347 (1998). 

[12] B. Coecke, "A representation for compound quantum systems as individual 
entities: hard acts of creation and hidden correlations" Found. Phys. 28, 
1109 (1998). 

[13] B. Coecke and F. Valckenborgh, "Hidden measurements, automorphisms, 
and decompositions in context-dependent components" Int. J. Theor. Phys. 
37, 311 (1998). 

[14] M. Czachor, "On classical models of spin" Found. Phys. Lett. 5, 249 (1992). 

[15] A. Fine, "Joint distributions, quantum correlations, and commuting observ- 
ables" J. Math. Phys. 23, 1306 (1982). 

[16] N. Gisin and C. Piron, "Collapse of the wave packet without mixture" Lett. 
Math. Phys. 5, 379 (1981). 

[17] K.A. Kirkpatrick, "Classical three-box "paradox"" J. Phys. A 36, 4891 
(2003). 

[18] K.A. Kirkpatrick, ""Quantal" behavior in classical probability" Founc?. Phys. 
Lett. 16, 199 (2003). 



22 



[19] J.E. Marsden and T.S. Ratiu, Introduction to mechanics and symmetry, 
Springer- Verlag, 1994. 

[20] I. Pitowsky, "Deterministic model of spin and statistics," Phys. Rev. D 27, 
2316 (1983). 

[21] T.A. Schilling, Geometry of quantum mechanics, Ph.D. thesis, Pennsylvania 
State University, 1996. 



23 



